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2 (57) Abstract: A method of combining data with other material comprises the step of repetitevely distributing the data in the other 
material. The data is for example metadata associated with the other material. The other material may be one or more of video, audio 
O and data material preferably in a defined file fomiat e.g. MXR The materia) and data torn the file are preferably mapped to one of 
^ several signal interfaces such as SDL SDTI and AES3, where the file metadata is repetitively distributed through the stream signal 
interface by one of several multiplexing methods. 
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:l: COMBINING VlbEO^ 

The present invention relates to a method and apparatus for combining data 
with other material. The present invention also relates to a signal processing apparatus 
arranged to carry but the method, a digital bitistream and a computer pfbgram prodiifet 
5 ^Material' means any one or more of video, audio, and data essence. "* 

Embodiments of the invention relate to combining metadata with material. 
Preferred embodiments of the invention relate to combining metadata with video and 
audio material and the invention and its background will be discussed by way of 
example, and for greater clarity, with reference to such preferred embodiments but the 

10 invention is not limited to that . > - : : : • ; 

Metadata is infomisitioh associated with material such as video and audio. 
Some types of metadata describe the form of encoding df e.g: a cdmipressed video 
signal to assist in the decoding thereof. Other types of metadata describe the content 
of the video. For example such descriptive metadata may include the tide of the vide6i5|^ 

15 and other uifoimation such as when and vdiere the video was shot Yet other types ofj^ 
metadata are technical information such as aspect ratio, lens used, video format etc^^^ 
Yet further . types include information . such, as Good , Shpf Marteire,^^ 
information, and information about people appearing in the video. Many other typesn^- 
of data may be metadata. z^^, 

20 A prior proposal suggested that metadata is stored separately firom the material^g 

witii which it is associated. The metadata may be stored in a data base and some meana^^:;?, 
of linking it with the material is provided. Such means could be e.g. a code on a^^ 
video-cassette. If the link is lost then the metadata cannot be associated with th^jr^v , 
material. If the database is destroyed then the metadata is lost Thus it is desirable t<?S:: 

25 combine at least some metadata with the material. 

It is necessary to store material in a store such as> digital video tape recorder 
(DVTR)or a digital disc recorder. It is also desirable to repeat metadata so that it carC* 
be accessed more easily in e.g. a tape record without needing to spool back to the, 
beginning of the tape. However most DVTRs and disc recorders have a data format ; 

30 which does not provide data space dedicated to metadata repeated at regular intervals V 
in the digital bitstream. 



wo 02/21845 PCT/GBOl/03967 

2 

According to one aspect of the present invention, there is provided a method of 
combining digital data with other digital material comprising the steps of:' 

structuring the said digital: data into a data structure having a key field, a length 
field and a value field, fte value field containing the data; 
S creating a digital bitstream having, a predetemoined repetitive format 

compatible with a data recorder each> repetition of the format including at least one 
data space for the said other material and sl data space for other data; and 

repetitively including the^ data; stmcture overia plurality of repetitions of the 
fonhat, the said data structure being^'included in the said: other. data :space or in part of 
10 the data space ofthe said other materia.:- . - . >j . i ' . 

. :! . .By including the data stnicture m the said; format^^ the dat can be 

accommodated in the format of the data recorder. The repetition allows the data 
structure to be accessed without the need to return to e.g. the beginnihg of a tape if the 
recorder is a tape recorder. 
15 A further step of the method optionally comprises the step- of mapping the 

combined data and other material into a file in which the : said data stmcture is 
contained in one part of the file and the other material is contained in another part of 
the file. ■ . " 

Preferably the file comprises a file header, a file body containing the said other 
20 material:^ and a ffile footer. Most preferably the file is an. MXF file and the data is 
Header'Metadata thereof. . 

Material, especially video and audio, may be stored in various difierent types 
of ^ore including t^e recorders and file servers and transferred between them. Thus 
by organising the combined data and other n:iat^al as a file the transfer is facilitated. 
25 The said format may that of an SDI bitstream or that of an Serial Data 

Transport Interface (SDTI) bitstreaih, the said other material comprising at least video 
material which is uncompressed in the case of SDI and compressed in the case of 
SDTI. The compressed video material is contained in a picture item of an SDTI 
bitstream. Both formats are based on video firames. 
30 Both formats may include audio firames,- which can operate in audio and in 

non-audio mode. In an embodiment of the invention, the data structure is included in 
audio firames operating in non-audio mode. 



wo 02/21845 



PCT/GBOl/03967 



3 

SDI has a Vertical Ancillary Data (VANC) space. In an embodiment of the 
invention, the said data structure is included in the VANC space. . 

In SDTI, the VANC . is included in the picture dtem data space. In an 
embodiment of the invention, the said data structure is included in the VANC space. 
5 SDTI also has a system item. In an embodiment of the invention, the said data 

stmcture is included in the system item. 

In preferred embodiments the data stmcture is encoded in a group of packets 
called a packet set: ■] Each set includes an^ integer number of ;whole packets where the 
integer^nimaber includes one.i The packets include integer numbers of whole KLV 
10 encoded items containing the data of ffie structure where a . value field V cbntains the 
data^ a length field indicates the;length of the value field and a key field indicates the 
■• type of packet.-:.- -li']' - ^.^z- • 

^ In SDI,- one packet set preferably occupies one Vertical Blanking Interval 
(VBI) video line in the VANC space. The packet may be null-terminated to occupy 
15 oneVBI;line. ; 

.In SDI, each repetition preferably:begins in a new &ame,ra^ 
f in a new packet set. : 

In SDTI, one packet set preferably occupies one uncompressed video line in 
' theiVANG space; The . piacket set may be null terminated to occupy one whole line. 
20 : : Alternatively, in SDI and in SDTI, i one packet set preferably occupies one 
audio frame operating in non-audio mode. The packet may be null -terminated to 
occupy one whole audio fiame. « 

Alternatively, in SDTI-CP, one packet set preferably occupies the metadata 
area of the system item data space. 
25 A fiirther aspect of tihe invention provides a computer program product 

containing program instructions which when run on a suitable signal or data processor 
implement the method of said one aspect of the invention. 

Other aspects of the invention are specified in the claims to which attention is 

invited. 

30 For a better understanding of the present invention, reference will now be made 

by way of example to the accompanying drawings in which: 

Figure 1 is a schematic diagram of the overall data structure of an MXF file; 



wo 02/21845 



PCT/GBOl/03967 



Figure 2 is a schematic diagram showing the data construct of header metadata 
of Figure 1; 

Figures 3A to D are schematic diagrams showing the mapping of header 
metadata over a packet stream; 
5 Figure 4 is a schematic block diagram of a signal processing and material 

transfer system; 

Figure 5 is a schematic diagram of an SDI field; 

Figure 6 is a schematic diagram of an SDTI-CP frame; 

Figure 7 is a model of the data structure of SDTI-:CP content packajge; 
1 0 Figure 8 is a model of an element used in an SDTI-CP content package; 

Figure 9 is a schematic diagram showing audio jackets; , 

Figures 10 to 12 are schematic block diagjrams of illustrative systems for 
implementing the system of Figure 4; = , , 

Figure 1 3 illustrates a nettyork showing the video and audio material streamed 
15 over SDI/SDTI interfaces together with file transfer over . a comjjuter network 
interface; and . . ^ ? 

Figure 14 illiistrates an altOTiative system for mplenaenting the system of 
Figure 4. 

20 MXFfile ^ , ..^ 

Referring to Figure 1 , there is shown Ihe overall data structure of a file. 
Such a file is referred to herem as an MXF file (Materi^ eXchange Fonnat). The 
purpose of the Material Exchange Format is tq exchange prpgraimne material together 
with attached metadata information about the material body. The MXF file is intended 

25 for the transfer of programme material and metadata between disc-based file servers 
for example. 

MXF files are defined by a sequence of Key, Length, Value (KLV) coded data 
packets. 

Header Metadata is structUKsd as folloTO^^ 
30 Individual metadata items coded wdtii KLV, 
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Logical groupings of metadata items coded as metadata sets coded by KLV where 
the Value is a collection of KLV coded metadata items, and 

Logical groupings of metadata sets coded by KLV where the value is a collection 
of KLV coded metadata sets; 
5 where the top level is the Header Metadata at the outermost level. 

The file comprises a file header, a file body and a file footen The body contains tiie 
"essence" tiiat is, in this example, video aiid/or audio essence data. The essence may 
alternatively be, or additionally include, essence data. ITie following description refers 
only to video and audio for convenience of description. 
10 It will be appreciated ihat Figure 1 is not drawn to scale. The body is much 

greater than the preanable and p^ Tlie body may contain 99% or more of the 

to^ data consent of ihe file. 
The file header 

ITie file header contains a Preamble followed by Header Metadata, and 
15 optidiiaiiy an index table. 

The Pre-amible preferably starts with a fixed Run-in byte sequence of e.g. 8 
bytes. liia^is followed by Key, Length Vialue (KLV) encoded preamble data pack 
which comprises: 

an SMPTE Pack label of 1 2 bytes (the Key); 
20 followed by one or more Length bytes, (4 in this example); which 

is' followed in ^Ms example b^ a null filled value field. TThe length byte 
iiidicates &e amount of da^ 

' 1nhL(5 SMPTE p^bic label defines A^^^ as an MXF file 
The file footer 

25 The MXF file is terminated by a File Footer. The footer contains an optional 

index table followed by a Post-amble. 

The Post amble comprises a KLV encoded post-amble data pack. The post-amble 

data pack comprises a SMPTE pack label of 12 bytes, and one or more length bytes (4 

in this example). In this example there is no value field and the length byte indicates a 
30 length of zero. In some circumstances, a vialue may be in, or added to, the vale field 

but would be ignored by an MXF decoder. 
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The Index Table 

The index table provides a means of rapidly locating specific data, e.g. video 
&ame starts^ in the file body. 

The index table is an optional metadata set, which can be used to locate 
5 individual jframes of video essence arid related audio and data essence. Index files may 
be placed either immediately before the Body, linmediately after tiie Body or 
optionally (Bkributed throughout 

An index table can be created *on the fly' during file creation firom a stream 
input and is notionally placed at the end of the file on recording. In practice, its 
10 placement in a server file system may be an^^here for storage convenience. During 
' transfer of a complete file, the Index table is placed in the MXF file header. 

Index tables are not necessary for body container specifications which are 
. ^ . ; defined with a constant number of bytes per firame, so their, incliision in the MXF file 

is optionial;-^." 'n: • V. ■ ■•! ; ■ ■ ' : i ^^ 

15 Header Metadata. 
' : ' ; ' ili^ preamble compris^^ Headbr Metadata, The iaetadkta n&y b6 any 

• iMbxmaition'sissb witli th^ e^^eiice cbritamed ih' tiib'iile body: The nietadata may 
. K be desciiptiye of the:esse?nce; be technical data relating to ffie essence or iany other 

•,<! infbnnation;'CitAi. ^- iw'i. b::^b- r- . ••■(-^ ' ■•' ■ 

20 'V ^ By way of examplei orily, descriptive metadatalmay compfiise data relating to 
, the produc?tipn of video materid such, ais P^^ ID (PID), Titie> Working Title, 

Genre ro^ Synopsis^ Direptor DDfi Picturestampi Keywords, Script, People, e.g. names 
and otho: details of performers and production crew. 

By way of . example technical metadata may comprise , data such as display 
25 aspect ratio, picture dimensions in pixels, picture rate, camera type, lens identification, 
and any other technical data. 

Metadata may also comprise data relating to edits in the material. It may 
cbiiipirise insthictibns defihihg simple editing and other processes to be perfoimed on 
the material. 
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Referring to Figure 2, the Header Metadata of the preamble comprises 16 bytes 
of Header Metadata Universal Label (UL), followed by a length byte followed by 
KLV encoded metadata sets (sets 1 to n) which constitute fhe^data of the value field 
(V). 

5 The UL defines the data value (V) following the UL as MXF Header Metadata. 

Each KLV . encoded metadata set n comprises , a set UL of 16 bytes, which 
uniquely identifies that set, one or more lengthy bytes and a set pf KLV coded metadata 
items constituting the data in the value field V of the set The length byte indicates the 
length of the value field . The UL defines thie cbnipiete list of metadata items present in 
10 tfaeseth. " - 

Each item is KLV encoded, comprising a 16 byte item UL, one or more length 
byt«5 ahci tti^ data in' the value feid V. The UL defines tiie type of content in the value 

-.field.;:. -J '^.v^f; ........ •• . 

■ : ; It will be appreciated that a set n may itself contain a plurality oftKLV encoded 
15 sets of data. An item may contain one or more sets of KLV encoded data.^ • • 
The File Body . . , : 

,^ Apjcxampl^^ wiU,jte desOThjC^ an SDTI-CP 

content p^ckagp^^^c^ :Other wntdnei^/igay.b^ 

. The contents of the file, body depend on the videOi;iand/or audio* and/or data essence 
20 contained in it and the manner in which it is encoded. For example^ video may be 
- compressed or imcompres^^ 

Each essence firame is KLV"encodediin^^a^^^^ 
content package^ which contains difiTerent essence types, each type is separately KLV 
encoded. ■ i 

25 Each container type has a liniqiie and registered Universal Label UL as a Key in 
the KLV coding. ' ^ ^ ' 

Each essence type within a container may have a unique key. 
The amount of data in the file body is unlimited and bound only by the file header 
and file footer. The data in the file body could be for example many Gigabytes. 
30 MXF Header Metadata Repetition 
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The Header Metadata may be repetitively distributed through the file body. The 
Header Metadata in the file body is additional to the Header Metadata in the preamble. 
This has the advantages that: 

if a file is interrupted during a transfer recovery of metadata is possible; and 
5 an MXF file allows random access to data ydthin the file body. The repetitive 

metadata allows easier and quicker access to. metadata renting to randomly accessed 
data because it avoids the need to. scroll to the l?egiiii^ or cAd ofihe{Skt. , 

Repetition of Header metadata in the file bodyis optional but has np; connection 
;With the repetition of rnetadata,in .accordance with embodiments of this invention. 
10 ^ ■ llie foiregoirig desOT sets out some of the basic features of 

There are^bther features but they are notrfelevant to fee preset iriv&tionf>^ 
. j; Svsteia ovi&rview - '-"i--- - ■ ' ■■ • ^ ' 

' iStefOTin]^ to tig^ 4^"^ signal processing and mkrterial transfer- ^^rart 
c6m^ an iiiterfkM 

is- fbrihats ti^^^buice to ^biirc^^'oode mio a c'oiitaiiier mS'ian mterface 

• l^^Wliic^ejQii^st^ The MXF file is 

ft^iis^OTbd^ whicE (l^dapsulat^s^ihle file;^ retiieveis the container 

j&om tiie body^ the sotirce Cod^^r the encoded sbiirce code is retrieved firofe the 
' If €aicoded the source cbde! is^ decoded lii a decbSer 26. 

20 The source code may be utilised in a utiliser 28 which may be for example a display 
device or aiiy other processor which bperatejs on or requires source code. 

The transfer from the interface 1 8 to the interface 20 may be by storage in a 
disc such as a computer data disc or transfer by a comrriuhications network using 
Internet Protocol Packets for example. Other meaiis of transfer may be used including 
25 other networks fbrexample Ethernet and Fibre Channel. ' ^ 

The encoder 14 may be a compr^sibh encoder such as an MPEG2 encoder. 
Other forms of compression may be used. The decoder i26 corresponds to the encoder. 

' Thb interface 20 is an MXF .decd<ier Winch is able to decode at least the 
foUowmg of an MXF file: 
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the KLV container structure of all parts of the file (including the data structure of 
any kind of Body); 

the Header, including the Header Metadata structure; and 
the Footer. 

5 Stream Interface for Uncompressed Material. 

An example of a stream interface for xmcdmpressed digital video and audio 
material is the Serial Digital Interface (or Intisrconnect) (SDI) defined in SIVIPTE 
259M. SDI is well known in the art and so will not be described in detail herein. 
' Figure 5 is a schematic model of video and audio mapped onto the SDI structure. SDI 
10 ; usesmterlaced fields In Figure 5, SAV denotes Start Active; Videp^.EAV denoted End 
Active Video, H denotes line scan direction and F denotes vertical scan direction. 

The SDI transport comprises a video frame in .which data is carried in the lines 
of the frame. A field has essentially the same stnictiire. The firame has a Vertical 
;^J^^^Jr^? i^^^J^^ (VBI) a Horizontal Blanldng jtateryal and an active video space. In 
15 ■ Spi, the VBI can be used for the carriagi? , of Vertical Ancillary Data (VANC), and the 
.Hori?;p|iM blanki^ig, inters c^ be used for the. cairiage ojfHori^ Ancillary data 
(HJ^ active yi^eo ^pace is ti^ie space for the main data, e.g. digital video. 

AES/EBU digital audio ichann^ls.may be pontained in.the HANC as defined by 

?7^M: Such a^udip cl]annels compr^^^^ frames, (which are explained in 
20 more detail below)' 

In accordance with illustrative examples of the invention, the VANC contains 
Header Metadata as described above. 

. In accordance: with another embodiment Header Metadata may be mapped into 
audio firames of the audio chaxmels. Each audio channel can carry either audio or non- 
25 audio data where the non-audio data can. be any data s;uch as metadata. Whether data in 
an audio frame is audio or non-audio data is mdicated by a flag in known manner. 
Stream Interface for Compressed Material. 

. . Aq example of a stream interface for compressed data such as MPEG 2 is 
SDTI CP which is described in SMTPE 326M. Figure 6 is a schematic diagram of an 
30 SDTI-CP frame having two fields. An SDTI-CP field does not accommodate vertical 
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ancillary data VANC. The active video space contains lines allocated to "Items"- 
System Item, Picture Item, Audio Item and Auxiliary Item. As shown in Figure 7, the 
items contain one or more elements. Elements ar^ shown in Figure 7 in relation to the 
picture item as an example. An item comprises one or piore elements. An element 

5 comprises one KLV encoded data block as shown in Figure 8. Compressed video is 
contained in a picture element within the picture item. An SDTI data stream may be 
derived by mapping m known manner the data contained in ari SDI data stream into an 
SDTI data stream, together with compression of the video. 

An MPEG 2 Elementary. Stream CBS). may onbed^Vertical Ancillary Data 

10 withm the elementary stream according to the SMPTE .standard SMPTE 328M. If the 
SDTI CP stresanj^is^derived ftorn Spi a|nd Vi^ 

ni^pped i^to ibeMPmiES/^ embodiments of 

the invention, the VANC data is Header Metadata. The Ancillary Data space uses one 

'brmoreuncompi-e^^^ '^^'^5®°^^"'^^?^^^^ 
15 <iak reduces ihedak'spa^^ , 

An SDTI-CP audio itan contains one or more audio elemeiits which may 
contain 1 to 8 kudio ch^elis in ^ch eleihent. Each audio chanhk wiftm an element 
" ' cm carry ei^er audio the non-audio date c^^^ any data such 

as me&ata; W^e^ 

20 a flag ii&vvn niannbr. Header metadata may be mapped into audio frames in the 

audio i^ iri ac<»r<&ince with an emliodiment of the invention. 

Mapping Header Meta data over a packet stream 
la accordance with embodiments of the invention. Header Metadata is 
organised M shown in Figure 3. 
25 Referring to Figure 3 A, the.ovj»all data structure of Header Metadata is shown as a 

single entity! and is exactly the saine M-?ho7m^^ 

Metadata data structure is KLV encoded as ,^pwi in and scri1|^^.4,^^,r?%^<* *° 
Figure 2. It comprises the Universal Label (UL) of 16 bytes foljoyyed by on^ more 
length bytes foUowed by a sets ofmetadate in the vdue field. . , 

30 Referring to Figure 3B, the compiete date structure of Figure 3 A is distributed into 
Q Packet Sets 
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Refeiring to Figure 3C, each Packet Set comprises in packets. As shown in Figure 
3D each packet is KLV encoded: Refeiring to Figure 3D, apabket comprises 
a packet start sequence, 
a data type byte, 
5 a length byte, 

a 1 byte channel ID, . . , 
a packet coimt of two. bytes,' J 

a set of comiplete metadata KLV blocks and • : 
"-' ' adRCcodeP ' ' ^ •' - - 

maidniumbf255bytesintk^^ ' 

metadata relating to different channels of essence. The channel K) identifies the 
channel to which the metadata belongs. 

.^1. ,::-rf^5^yr.?^ ^'^"frS^^^ encoded 

,?f",°?^' ^^^^]^f^ °f a sequence e^ 

sequence has akey, e.g. pf 16 bytes, tp^low' Ae pack^^ sequence to be 
20 identified and to maintain the contmuity of the data of ithe metadata item. 

The first packet in a ^anae/if it i^part WamijItipl^^^ also has such 

akey.''' ' ' ' jinr. . •-■■;! 

Hie packet count identifies the packet number within the defined channel 
number Typically,' tlis count uses 2 iiytM wWch allows a seqiienbe of up to 65536 
^ this for example 

^'^^^''^f* ^^^^^^"^ wi& paiiket 0 ik packet set ^1 aid coiitinues incrementing 
tlirtughout the E piacket sets.' 

Mapping of Packets in accordance with e mbodiment of the invenfinn 
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The packets of Header Metadata are mapped, and embedded in an SDI or SDH 
data stream, on a repetitive basis, as follows: 

a) for uncompressed video over SDI, it is mapped into one or more VBI lines 
asVANCdata; 

5 b) for compressed bitstreams in SDTI, it is mapped into one or more 

compressed video frames of payload data space, being mapped into the ancillary data 
space such as may be provided by extensions to the MPEG2 ES syntax (as provided by 
the SMPTE standard SMPTE 328M); or 

c) alternatively to a) and b), it is mapped into one or more audio frames of one 
10 or more audio cKaimels, e.g. AES 3 channels operating in non-audio mode. Such 
channels exist in SDI, and mSDTI-CP. '' . . , . ^ .i 

' d) The Header Metadatia is-pkdded to occupy an integer number of frames, so 
that when the Header Metadata is repeat 

a new frame. By starting 'each complete data structure of Header Metadata on a 
15 new frame, break-up in editing bperationis is ifeduced br nunimised. 

e) The Header Metadata is packetised with a packet structure which includes 
at least the packet channel identification ( the cliannel ID) for multiplexing 
with othLer pacicetised metadata, and the packet sequence count (so detection 
of the first packet is easy) 
20 f) each repetition of a complete Header Metadata data structure starts in a new 

packet, preferably packet 0, for ease of data parsing 

' g) Referring to Figure 9, when mapping Header Metadata into AES3 non-audio 
frames, the Metadata is mapped into a window spaced from the beginning and end of 
the audio frame by guard bands to increase reliabihty in the presence of timing errors 
25 or edits. The guard bands are nidi-filled. 

An audio iframe is the amount of audio data which occurs in the time interval of 
a video frame. For example, if analogue audio is sample at 48KHz, and the video 
fi^e rate is 25H2;, then an audio firame consists of 48000/25 bytes =1920 bytes. 
Refemng to Figure 3B:- 



wo 02/21845 



PCT/GBOl/03967 



13 

a) In SDI, the packet sets 1 to p.are assigned to respective VBI lines in SDI and 
most preferably only two lines of VBI are used per SDI frame, (i.e. one line per. field) 
although more than two lines per frame could be used; 

b) In SDTI, the packet sets 1 to p are allocated to the ancillary data space 
5 within an MPEG2ES data stream; 

c) Altematively, in SDI and in SDH the packet sets 1 to p are allocated to 
respective audio frames: Preferably one audio frame contains only one packet set. 

Each packet set preferably occupies a whole SDI VBI line or audio frame with 
one packet set per line or per audio frame. Any spare data space on the line or in the 
10 audio fiiame is null filled. One line or one audio frame typically contains about 1400 
bytes in examples of the invention, that is about m=5 packets using V-ANC as shown 
. , in Figure 3 C. Because one complete, Heajier Metadata data structure is likely to be 
• much greater tha;i the data space available inpne firame, it is spread oyer many packet 
sets 1 to pL For tliatpiupose,:thepa sequentially to identify all the 

15 packe^te oyer/^^ which contain one; complete Header Metadata jd^ta 

structure. Because any spare^^ace in a packe^t set in any firame is null-filled then the 
. complete Header.Metadata data structure pccujpies an integer number of firames. Once 
a Cfomj>Iete Header Metadata data structure has beien distributed over one group of p 
packet sets it is repeated in the succeeding group of p packet sets. 

20 The repeat of the . complete Header Metadata data structure begins in a new 

firame with packet 0 in packet set 1. 

Several different complete Header Metadata data structures may be interleaved 
in respective channels identified by the channel IDs. 

. . , Jn sunrmary, a complete Header Metadata data structure is disftributed over an 
25 integer number of packet sets. Each packet set has an ijqiteger number of packets. 

Preferably, one packet set occupies only one VBI line in SDI or one audio firame; any 
data space not used on the line or in the frame is null-filled. Each repeat of a complete 
Header Metadata data structure begins on a new video or audio firame in a new packet 
of preferably preset number such as packet 0. This allows each complete Header 
30 Metadata data structure to be easily identified and its start position is easily found 
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because it is consistently aligned with the video jframes in SDI or with the audio 
frames in SDI and SDTI. 

In SDTI where the Header Metadata is embedded in an MPEG2 ES data stream 
in an SDH picture item, the packets are contained in Ancillary data lines in 
5 accordance with SMFIE 328M. 

Illustrative impleihentations of the invention 

Fi^es 10 to 12 are schematic block diagrairis of illustrative systems 
for impleniehting the system of Figure 4, witii the repetition of Header Metadata in 
acdorddnce With the Jnvei^^ to ii2 like blocks are denoted by like 

10 reference nimiera^^^^^^ Mowihg description^ and 12 ignore the audio 

' cifiabnii Tb^^ 
^HfeadCT Metadata. ' 

' iii Figuii^iti/Hfead^ created in aiaMtodata creybx 3dJ The header 

metadka' Kai -t^^ data Wnicture^ shbS^ni in iFigi^res^i and that metadata structure is 
^15 mai^^ 3i As iiescribed^^ section 

'^Mapping of Packets in accordance with embodiments of the ime^^^ fhe Header 
Metdd^^ " is inserted into &e VaNC of an^^^^^^ using a suitable 

' rnuitxplexer 90 in an SEil interface 32 and the Header Metai&ta is repeated, ieach repeat 
begimiing in a neW p^^ beginiiing of a VBI Hrie in a new frame, 

20 - ' each rompiete^ ^ata structure ooci^ng a integ^ number of frames. 

Preferably y describbd above one frame bbntains only one whole packet set p on one 
■'"^ VBIlinel' ^^'^ ' • " "^'^^ ' ^ ' " ' \' 

' liie Sbl data structure contains uncompressed digital video in its active video 
data si)ace. An MPEG encoder 34 compresses the digital video into an MPEG2 ES 
25 ' elemehfary streani and maps the SDI VANG containing the Header Metadata into the 
anciiliary data space of the elementary stream. 

" An SDTI-CP mterface maps the MPEG2 ES, containi n g the repeated Header 
Ivietadata, into tlie picture item of an SDTI-dP ' content package. There is no 
predetermined position or' timing of the Header Metadata in the picture item of the 
30 SDTI-CP content package. 
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. A digital data store such as a digital video tape recorder or digital disc recorder 
38 which is designed to store SDTI-CP content packages records the SDTI-CP content 
package. Because the Header Metadata is in the MPEG2 ES cbntamed in the picture 
item, the recorder 38 is able to store the repeated metadata without violating its 
S formatting rules. 

The video and the header Metadata may need to be transferred to a computer 
network and/or computer file storage, denoted schematically at 46. For that purpose it 
. is converted to an MXF file in this iUustrative embodiment The SDTI-CP bitstream is 
reproduced by tjie recover 38 and fed to a de-embedder 4Q. The de::einbeddder 40 
10 separates the Header Metadata fr^^ MPEG2 ES of the SBTIrpp 

content package and suppU^^^^ an MXF^file creator 42. Assuming the SDTI CP 

bitstream contains only one Header Metadata structure and its repeats, the de- 
emtedder pjreferably supplies only one complete Hea<|er Metadata data structure (and 
no repetitions of it) to the creator 42. The MXF creator 42 maps the Header metadata 
15 into tiie file header of the MXF file and the 1^EG2 ES stream. into the file body of .the 
MXF file as shovm in Figure 2. 

The MXF file may be transferred to the network and/or coinputer file storage 
. denoted schematically , at 4^^ 
and/or storage 46 to a recorder 54, which may be identical to the recorder 38. The 
20 MXF file is| fed to a demultiplexer 48, which separates the Header Metadata fi-om the 
file body of the MXF file. The compressed MPEG2 ES stream of the file body and the 
Header Metadata are fed to respective inputs of an encoder 50 which repetitively 
embeds the Header Metadata into the ancillary data space of the MPEG2 ES stream 
which is then embedded in the p^icture item of an SDTI-CP content package by an 
25 SDTI interface 52. The SDTI-CP bitstreain is recorded in the recorder 54. The SDTI- 
CP bitstream may be reproduced by the recorder 54 and fed to an SDTI. decoder 56, 
which outputs the MPEG2 ES stream containing the repeated Header Metadata in its 
ancillary data space. The video is decompressjed by an MPEG2 decpder 58 and the 
Header metadata is mapped into the VBI of an SDI stream and the decompressed 
30 video is mapped into the active video space of the SDI stream. The decompressed 
video and the Header Metadata may be derived firom an SDI interface 60. 
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The embodiment of Figure 11 vises , an audio channel to contain hea(Jer 
metadata. Referring to Figure 1 1 , Header Metadata is created in a metadata creator 30. 
The header metadata has the data structure shown in Figures 2 and 3. The Header 
Metadata is inserted into audio frames as shown in Figure 8 using a suitable 
5 multiplexer 92 in an audio interface 44 and the Header Metadata is repeated, each 
repeat begirinmg in a iiew packet (packet m=0) at the begiiming of a a new frame, each 
complete Header Metadata data structure ocpupying a integer number of frames. 
Preferably as.describ?d .above one frame contains oiily one whqte. packet set p where 
: .eachpackftsetcon^^ 
10 The Spi bitstrearn contains imcbmpresse^^^ 

spape... An , MPEG eiicodCT.;34 . copapresses\&^ ES 
..elementary, stream..-;^ . • ' i - . ■■■:r.^ r^^-':- 

An SDTIrCP, interface 36 maps the iyiPEG2 ES, into the picture item of an 
jSDTI-CP content package. The audip cpntaining. the repeated Header, Metadata is 
15 : mapped into, the audipjteni of the^^ 

The Iblpeks 3 8 to, 48 of the embodiment of Figure : 1 1 , operate; in the same way 
as discussed >yith reference ito Fi ; ; i ;; ,Vi 

The encoder 50 embeds the header metadata repetitively 4ntp^ai^|dip^ frames and 
an SDTX-CP. encoder 52 maps the. audio fo^ of an SDTI-CP 

20 content package and maps the compres3^d Mdeo to ^the picture item, The SDTI-CP. 
bitstrearn is recorded in recorder 54 reproduced and decoded in a decoder 56, which 
separates the audio ifrom the MPEG2 ES stream. An audio decoder 62 separates and 
outputs the Header Metadata and audio. 

The embodiment of Figure 1 2 operates in much the same way as that of Figure 
2i5 10 except that the Header Metadata produced by creator 30 is embedded using a 
multiplexer 94 of an SDTI encoder 36 in the system item (shown in Figure 6) of an 
SDTI-CP content package. Referring to Figure 6, the Header UL of the Header 
Nletadata follows immediateiy after the SAV in the system item. Blocks 38 to 54 
operate as described witii reference to Figure 10. The SDTI decoder 56 separates the 
30 Header Metadata from the system item. 
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Those skilled in the art will recognise that, at the priority date of this patent 
application, whilst SDH with isystem items is allowed in the relevant SMPTB 
standards^ many data recorders,^as exemplified by 38 and 54, do not yet support the 
use of system items. 
5" niustrative NetWork 

Figure 13 illustrktes a network which lises streaming fonriat signals 
such'as SDI and SDTI and MX^ An SDI bitstfeW is ^^pplied^t MPEG 
' ' digital video tepe tecorder 10 video (and 

audio) components of the SDI bitstream and records the The 
10 recoWer in this^^x^ containin^^the 
^ encoded compbrients for traiisfer to a \ddW ffle 102 Wta records: breaming 
format signals. The server 102 has an interface wMch produces 
' - delivers MXF files to a computer network 106 Mving^ filfe s^ 104, a router 108, a 
ccihtml- iibb^^ a Tape archive 1 ii2. ^ fife alfo exchange of 

15 material between the tile senders 104; ■archivel 12' ahd' the video file se^ 102i ' 
' - '^^Headar inet^datia is mSif^ as described 

above. The MXF files are produced by the seiner 1 02 -as described above. 
■■- - Modifications ■-■^-''••'a * -:-••:•-.(;:*■; 

' Embodiments of the iriventibri have been described above with reference to 
20- MPEG2 conipression systems/ ^ Any other cbn^^ be used: 

" Embodiments of the ihventidn hkve- been described above with reference to 
MXF fiiesi Other types of fiGie may be used i>rovided ffie Header Meta^^ repeated as 
described above can be mapped into the file. * * 
Ejnbodiments of the invention to^ 
25 Spi and SDTI. Other formats qan be used provided the Header Metadata can be 
packetised, repeated and mapped into video or audio frames as described above. 

Figures 10 to 12 show mapping of SDI into SDTI followed by mapping of 
SDTI into an M3CF file. In alternative embodiments, SDI is mapped directly into an 
* ^^^^ ^^^y containing uncompressed video. The Header Metadata is 

30 contained in audio firames or in the VBI lines in the file body. Thus referring to Figure 
14 Header Metadata is created by a creator 30. Audio is encoded by an encoder 44. 
An SDI encoder 32 inserts uncompressed video into the active data space. The header 
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Metadata is inserted into either audio firames operating in non-audio mode or into the 
VBI as described above .The metadata is repetitively distributed over the SDI video 
frmies in the VBI or in the audio iBrames as described aix)ve. A recorder 381 records 
the SDI bitstream without compression of the video. The recorder may be a disc 
5 recorder or a tape recorder The SDI bitstream is reproduced from the recorder and a 
data de-embedder 40 separates the Header Metadata! from the video and audio. An 
MXF file creator 42 maps the Header Metadata! mto the file header and the video and 
audio into ffie file body as shown in Figure 1. The MXF file may be trknsferred to the 
network and/or OTmputer storage denoted sdhematically at 46. The MXF file may 

10 be ti-aiisfeired jfrom the network and/or storage 46 to a recorder 541, which may be 
identical to the recorder 381. For that purpose, the MXF file is fed fi-om the 
neiworfe/storage ^6 to aii SDI encoder which maps the MXF file into an SDI bitstream 
with repetition of the Header Metadata as descrifeed above. The recorder 541 records 
the Stil bitstreani^^ be reproduced tterefirom and an SDI decoder 60 

1 5 separates the Header Metadata, the video and the audio. . 

The invention rnay be m on a digital signal or data processing 

system which is programmable. Thus the invention may be a computer program 
product containing iiistructions which when run on tiiie signal or data processing 
system implement the invention. 
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CLAIMS 

1. A method of combining digital data with other digital material comprising the 
steps of: 

structiuing the said digital data ioto a predetennined data stracture; 
^ creating a digital bitstream haying a predetermined repetitive format 
® ^^9?^ repetition of the format including at least one 

..^f\^,^^^^i^?^!^^,^^^^ 9f^^^ ^ space for other data; and 

: . . / •; structure oyer a plurality of repetitions of the 

f9^^ P9 <'^ .s*™<?jFe being included in the said other data space or in part of 



10 the data space of the said otiier material. 



. ,^K:^^S?M>U?^^^iui?-*^ *f^«,?»'<J ^^^-^^s metadata 

associated vwthtiie other material. 

.. . ^! ,; .:^™^?*^f^f*^^^ *° comprises 
video material. 

. . J . u:r. *e said at least one^;data space for the 

other inateri^ iiicludes a video data space. 

. " f/'^ °t^)Sf or srwheiein the sdd other material 

comprises audio material. ' 

6. A method according to claim 5, wherein the said at least one data space for the 
20 o&er material includes an audio data space. 

7. A method according to claim 6, wherein the said digital data is included in the 
audio data space. 

8. A method according to any one of claims 1 to 8, wh«ein the said digital data is 
included in the said other data space. 

25 9. A method according to any preceding claim, wherein the said other data space 
is an ancillary data space. 

10. A method according to any preceding claim, wherein the said data structure 
comprises a value field containing the said data, a key field and a length field 
indicating the amount of data in the value field. 

30 
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11. A method according to any preceding claim wherein the said fomiat is repeated 
in frames, and each repetition of the said, digital data structure begins, on a frame 
containing no, data, of a previous occurrence of the said data structure. 

12. A method according to claim 11, . wh^ein each occurrence of the said data 
5 structures is distributed over an integer number of frames. 

13..: A method according to claim 11 or 12, wherein the said data structure 
; : comprises: packets pf data, and each repetition thereof starts, in. a packet containing no 
dato of a previous jpcc]m 

14. 1 J ■ ; n A iHiethpd acco^^^ claim 12, whereinj.th^ ordinally 

10 . :fnimibered..a^^^^^ a packet having a 

predetermined;nuinbCT^ ;r r„;i.. ^n/J-;- b:. i.r-.. a--- ti 

15;. ;^Ajinethpdiaccording ta orA4, wherein each frame contains a set of 

packets.: of j the data? structure,; each iset ;C,oiisisti?ig- of an integer ^number : of complete 
packets. 

,15 ,16. A>methpd.accp 13,> 14 or 15, wherein the s£dd repetiti^^ 

•format is: thatof^a Serial Digi^ !v : v - 

. 17.; A method according to^ claim 16,: \yhere^ is repetitively 

included in audio frames operating in non-audiormode. - = : . : . : • ' . = 
.18, A method aecprdmg^to cla^ 17, whesn ^iep^ or 13, wh^ein 

20 each set of packets .i$ cpntained m a j^dpWj^#im .m.audio. ;fr 
spaced frpni:the;bpTOdaries-of the fr^ ; 

19. A method according tpjplaim. fl?, 'whereinr the i said, dat^^ is 

: included in a Yertical Ancillary . data space (VANC) of the. SDI bitstream. 
20:,: A method -according to any one ofclaims 16.to 19, comprising the fijrther step 
25 of creating an Serial Data Transport Interface (SDTI) bitstream from the content of the 
-- SDI bitstream. .: . -^f.}.: /• :.r;--.^ 

21. A method according to claim 10 or. 11, wherein the audid frames are 
contained in an SDTI data structure; i :i . 

22. A method according to claim 11, 12, 13, 14 or IS^iVdierein.the said 
30 other material comprises at least video material, and the said repetitive format is that of 

an SDTI bitstream having at least an audio item and a picture item. 
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23. A method according to claim 21, wherein the said data structure is repetitively 
included in audio frames operating in non-audio mode in the said audio item. 

24. A method according to cl^ 22 wheii dependent on claim 12 or 13, wherein 
each set of packets is contained in a window within an audio frame, the wmdow being 

5 spaced from the boundaries of the frame by guard ban^s. 

25; A method according to claim 21, wherein the said data structure is i^^^ 
a Vertical AhdiUaty data sp^ (VANG) \^thih thepictuiiitem bfthe SDTI bitstream. 
26. A method according to claim 21 wlien dependeht'dii claimll2 or 13, wherein 
one set of packiets is confined in diie lihe>bf the Vertical Ancillaiy data space. 
10 - TJr^^^A ififelhbd iaccidrding^to a 
system item and the said data structure is included in the ^j^teni itetri. 
28; ^ A>m5eth6d to any preceding blaii^^ herein ^a j^ cff diflEerent 

: data^^structures halving req)ective identifiers^ are-repetitively distributed in the said 
format. 

:15m^; 29::-r ' -A metHod according to any precediiig^^laini compri^ of mailing 

the combined data and other ihateriaJ frbin the said repetitive fonnat in^ file in 
vj?^. ^which the said datat stnictii^ part of the tel^^aiid the other material; 

. is contained in another piart of the file. > ' j-^ ohn; ; ,.. 

- 30; ■ : i A method' according to claim 29V wherein the^ file ^ comprises a file 
20v. . Jieadei;' a.fileb6dy containiii^ . 

31. A method ac(iording to claun 29 or 30, wherein the file is an MXF file 
' and the data is : 

- 32l <' A meflidd according to cla^ 29^ 30 or 31, comprising the fijrther step 
s ofnikpping the data stnicture and the other material from fl^^^ bitstream 

25 having a predetermined repetitive fbririat compatible with a data recorder each 
repetition of the format mcluding at least one data space for the said otiier material and 
a data space for other data; and ' 

repetitively including the data structure over a plurality of repetitions of the 
format; the said data structure being included in the said other data space or in part of 
30 the data space ofthe said other material.' • 

33. A method comprising the steps of: 
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receiving a digital bitstream including digital data in a predetennined data 
structure and other digital material, the bitstream having a predetermined repetitive 
format compatible with a data recorder each rq>etition of the format including at least 
one data space for the said other material and a data space for other data and 
5 repetitively including the data structure over a plurality of repetitions of the format, the 
said data structure being included in the! said other data space or in part of the data 
space of the said other material; and 

separating the said data structure ftom th^ othe^ material. 

34. A method according to claim : 33 i comprising the further steps of 
10 deriving the said signal ftom a file, mjc^:^ch,jth| said data structure and other 

material is m^ped and wherein the said is contained in one part of the 

file and the other material is contaSned in anothei: par^ of the file, by inverse mapping 
the said data structure and the other materia frcSrt:^ fil^ into the said signal. 

35. A method according to my^prec^di^^^ claim and substantially as 
15 hereinbefore described with reference 13 of the accompanying 

drawings. 1 '■ 

36 Signal processing apparatus ai^n|iJ |o carry out the method of any 

preceding claim.; . u ; 1 

37. A computer program prodiict ikr^gedl to carry out the method of any 

20 one of claims 1 to 35 when run on a signal pro0^o|. ; 

38. A digital bitstream incluain^- digilkl j data in a predetermined data 
structure and other digital material, the biwt^imi^ a predetermined repetitive 
format compatible with a data lefcOTder each r^tjoA of the format including at least 
one data space for the Said pther material and f^^^P^ for other data; and 

25 repetitively including the data structur| pyer iajplurality of repetitions of the 

format, the said data structure being includ^ 0^ siid other data space or in part of 
&e data space of the said otlier. material; : ^ 

39. A bitstream accordiife to claim iis, md produced by the method of any 

one of claims 1 to 35. 

30 40. A bitstream according to claim 39 and substantially as hereinbefore 

described with rrfenence the accompanying drawings. 
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